DOCUMENT RESUME 



ED 225 833 



SE 040 192 



AUTHOR 
TITLE 



INSTITUTION 
SPONS AGENCY 
PUB DATE 
NOTE 

PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Herbert, Martin 

Fifth Grade Evaluation: Volume I, Summary 
7-B-l. Extended Pilot Trial of the 
School Mathematics Program. 
St . Loui s , Mo . 
of Education (ED), Washington, 



Report 

Comprehensive 
CEMREL, Inc., 
National Inst 
Dec 80 

28p . ; For related 
SE 040 340-348. 
Reports - Research/Technical 



Evaluat ion 



DC, 



documents, see SE 040 181-196 and 



(143) 



MF01/PC02 Plus Postage. 

Educational Research; *Elementary School Mathematics 
*Grade 5; Intermediate Grades; *Mathematics 
Achievement; Mathematics Curriculum; Mathematics . 
Instruction; * Program Evaluation ; Testing 
*Comprehensive School Mathematics Program; 
*Mathematics Education Research 



AB S TRACT 

The Comprehensive School Mathematics Program (CSMP) 
is a program of CEMREL, Inc.. one of the national educational 



Education 
materials 
a series of 
Thi r ty-one 
finding is 



laboratories, and was funded by the National Institute of 
(NIE). Its major purpose is the development of curriculum 
for grades kindergarten through 6. In the spring of 1980, 
mathematics tests was administered to fifth-grade classes, 
CSMP groups and 25 non-CSMP classes were chosen. The main 
that CSMP classes demonstrated clear superiority over non-CSMP 
classes in many mathematical thinjcing areas as assessed by specific 
tests Particular examples included calculation in mental arithmetic 
and estimation, elucidation, and number relationships', as well as in 
fractions, decimals, and negative numbers. Gains "e seen as made 
without corresponding score decreases in more traditional instruction 
areas. Teachers' approval of CSMP and reasonably faithful 
implementation appeared to result in improvement in some areas, with 
a possible cost in computation that is often made up with teacher 
supplementat ioln . (MP) 
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Descriptioa of E\^aluatnon Report^Series * 

\ The Comprehensive School Mathematics Program (CSMP) is a program o'^' CEMREL, 
Inc., one of the natuiTial educational laboratories, and is funded, by. the National 
Institute of Educatidri/ Its major purpose is the development' of curriculum 
materials for grades K-6. 

Beginning in September, 1-973, CSMP began an extended pilot trial of its ' 
Elementary Program. -The pilot trial is longitudinal in nature; students who 
began using C^MP materials in kindergarten or fi rst grade' in 1973-74, were able 
to -use them in first- Bnd second grades respectively in 1974-75, and so on in 
subsequent years. Hence the adjective "extended". 

The* eval4iation of the program in th>s extended pilot trial is intended to be 
reasonably comprehensive and to supply information desired by a wide variety of ■ 
audiences. For that reason the reports in this series are reasonably non-technical 
and do not attempt to widely explore some of the related issues. The 1 ij§t of reports 
through year six -is giv^n.on the next page. The following reports are p^lanned for 
year 7: . " . ' ^ - 

7-B-l - -Fifth Grade Evaluation: Volume I, Summary • . 

7-B-2 - Fifth Grade Evaluation: Volume II, Test Data 

7-B-3 - Fifth Grade Evaluation: Volume III, Non-;Test Data 

^7-B-4 - Re-evaluatiorv,of Second Grade, Revised HANS-Tests^ ' ' 

; - Achievement of Former CSMP Students at Fourth Gra.de, 

. . 7-B-6 - Student Achievement, Rapid Implementation Model 
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Introduction to Volume I ' 



In the spring of 1980, a series of mathematics tests was administered to 
31 fifth grade classes using the Comprehensive School Mathematics Program and to' 
25 comparison classes using more traditional programs. ^ In addition to the testing, 
considerable information was collected regarding teacher and student attitudes and 

r 

implementation of the program. 
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A sunmary of all the results is given in. this volume which is Volume I 
(Evaluation Report 7-B-l ) of a three-volume set. Volume II (Evaluation Report 7-B-2) 
describes in detail the tests and results of the testing and Volume III 
(Evaluation Report 7-B-3) describes attitudinal and implementation data' and their 
relationship to the test data. 



Setting 

Description of Participating Classes 

CSMP -'31 classes (out of 44 classes studying CSMP in fifth grade) 

- located in 6 school districts; widely varied in geographic location, 

size and type of community and ability level of students 

- 23 of the 31 classes had studied CSMP since first grade, 8 since 

fourth grade 

- overall ability level about the 61st percentile rank in reading 

comprehension 

- about half the teachers received the recommended CSMP training (40 hours), 

but a'bout a third received less than 10 hours. 

non-CSMP - 24 classes 

- located in 6 school districts (same as CSMP except two where CSMP was 

taught in lower grades) 

- not randomly selected but as similar as possible to CSMP 

especially school location and student ability 

- overall ability level about the 60th percentile rank in reading 

comprehension 

- all but 2 classes used one of the various, widely used, "traditional" 

textbooks for mathematics. 



A brief description of the sites is given below. 

F Classes 
non-CSMP 

0 



Number of Classes 
CSMP 



6 
0 
5 



0 
2 
6 

3 

Total 31 



5 
3 



3 
2 
6 

.0 
25 



Type pf 
Coimunity 



Suburb of 
small city 



Small city 

Inner city 
of large city 

Inner suburban 
of large city 

Medium City 

Exurban 

Suburb of 
large city 

Suburb of 
large city 



Approximate Socio- 
Economic Status 

Middle 



Middle/Lower middle 
Low 

Middle/Lower middle 
Middle 

Middle/Lower middle 
Upper Middle 

Upper Middle 
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From questionndire data, further similarities and differences between CSMP and 

non-CSMP classes are summarized below: 

i.u • A-.., /cSMP = 59 minutes 

- Average time on unath instruction per day : J^^^^^j^^^p , 5^ ^^^^^^^ 

. X ^ u 1 ^ u /CSMP = 59% 

- Average percent time for^teacher-1 ed j^^^^j^p ^ 



- Average percent of time supplement ing:^^^^^j^p^^ 



23% 



- Areas of supplementing: ^ 

- both groups: basic number facts, mental arithmetic drills 

- more by CSMP: multiplication and division algorithm, 

fractions , decimal s 

- more by non-CW: money, time, graphs, enrichment 

- Median number of years teaching experience: about 10 years for .both 

CSMP and non-OSMP. 



Instruments Used 

The data summarized in this report are from the following instruments: 

• The Reading Comprehension and Computation Subtests of the 
Comprehensive Test of Basic Skills (CTBS), Level 2, Form s 

*The MANS Tests, a series of 27 short tests which attempt to assess 
some of the underlying processes of CSMP, without using special 
terminology or problem types. Many of the tests are built around 
mathematical situations new to both CSMP and non-CSMP students 
(hence the name "Mathematics Applied to Novel Situations"), They 
are administered by specially trained testers. Similar tests^ were 
grouped into categories which roughly parallel most of the 10 basic 
skills identified by NCSM and NCTM (National Councils of Supervisors 
' and Teachers of Mathematics). 

#A series of student attitude items 

• A teacher questionnaire which probed the way the math program was 
■implemented, teacher opinions about teaching math, and evaluations 

of their math program 

#An evaluation by teachers of each of the MANS tests 
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Test Results 



Comparison of Class Means ' • 

For each class, mea-n scores on each MANS test and 'on the Reading' Comprehension 
test were calculated. The various tests were grouped into 13 different categories 
Analysis of Covariance data on these class means are shown in Tables 1-3 for the 
various categories. In Table 1 are the categories in which CSMP classes did 
significantly better than non-CSMP classes at the .01 level. Table 2 is for 
categories where the difference is significant at only the .05 level and Tabl^e 3 
is for categories with no significant differences. There were no categories 
(or individual tests) in which non-CSMP classes had s^girij/icently lower scores. 



Table 1 ^ 
Categories with Large CSMP-Advantage 



J category " 


ns/tn^ 


2 

Adjusted Means 




CSMP non-CSMP 


p-valua , 


Mental Arithmetic 

Open number sentences to be done mentally, 
i.e., without '*scfratch" work. The answer 
box could appear on either side of the 
equals sign. Many of the items required 
more* than merely calculation skills. 


4/4 


19.7 


15.9 


.01 


Decimal s 

Simple word problems, relative size^ and 

1 inear measurements. ' ' . 

* 


2/2 . 


11. 1 


8.5 


.01 


Number Relations 

Solution and application of mathematical 
patterns and relationships involving the 
concept of number machines. 


2/2 


12.2 


10.2 

• 


.01 


Elucidation - ^ 
Find as many solutions as possible to 
-^gi ven problems. 


1/1 


16.2 


13.2 


.01, 


Estimating Intervals 

Determine whic-h of several given intervals 
contains the answer to a computation pro- 
blem. Short time limits were strictly 
enforced. 

^ - — - — . << 


2/3 

, 


15.6 


14.5 


■ .01 



1. ns/nt = number of scales in (^itegory which produced a significant difference 
divided by the total number of scales in category. 



2, Adjusted from Analysis of Covariance procedure on class means with reading comprehension 

as covariate (df=l »48). Since d,1f|erences in class means in- reading were .small, such 
I arfjustments usually amounfed to no more than'^O.l orw indrl^ldual tSsts. 

\ 




Table 2 ' . 

Categories with Modqirate CSMP Advantage 



Category 


ns/tn^ 


Adjusted Means'- 




CSMP 


non-CSMP 


p-val de 


Fractions 

Seven tests covering various aspects of 
fractions including representations, 
measurement, open sentences, word 
oroblems. relative size. anH MLiiv;)lant 
fractions. 


2/7 


33.0 


31 A 


.03 

t 


Probability 

Estimate frequencies of various outcomes 
and select best randopL^ri^ ces for a 
given outcome. 


1/2 


17.2 


15.8 

> 


.02 ■ 


Negative Numbers 

Solve problems in a game in which >iits 
anu HiidScs currcsponu uu 9^^'^-^ anu 
losses of a certain number of |Doints. 


1/1 


6.4 


5.8 


.05 


Word Problems 

Two and three stage word problemi with 
low verbal and computation load. 


0/1 


6.6 . 


6.1 


.03 



Table' 3 / 
Categories with No Significant Differences 



Category ^ 


ns/tn^ 


2 

Ad.i listed Mean$ 




CSMP 


lon-CSMP 


p-val ue 


Computation 

48 multiple-choice items, 12 for each 
operation. Roughly half the- items in- 
volved whole number algorithms, 
quarter of them involved fractions, and 
a quarter decimals., CTBS Computation 
test. 


0/4 


14.9 

* 


34.3 


.42 


Most Reasonable Answer 

For a giyen computation problem, determine 
which of 3 answers (all of which are wrong) 
is most reasonable. Short time limits 
were strictly enforced. 


■ 0/4 


, 12.9 


"12.9 


.82 


Measurement Estimation 

Estimate the answer to a visually 
^ presented problem in area, volume, 

height, etc.. A range of ansv/ers was 

accepted. 


0/1^ 


2.1 


2.1 


.81 


Organizing Data 

Given a graph in which weight is plotted 
against age, determine age per given 
^weights and vice versa, including 
interpolation. 


OAi 


6.5 


6.5 





1. ns/nt » number of scales in category which produced a significant difference (p<.05) 
divided by the total number of scales in category. 

2 Adjusted from Analysis of Covariance procedure on class means with reading comprehension 
as covariate" (df=l,48). Stnce differences in cUss means in reading were small, such 
adjustments usually amounted to no more than,0.l)on individual tests. 
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n categories was -calculated for each class and%liese 
ding scores in Figure 1. (The different symbols in 
different districts. The line draWn on the graph 
iNS score on Reading Comprehension score.) 




Fig. 1, Graph of Class Means - Total MANS versus Reading Comprehension 
CSMP Classes: ■ • Y ▲ 
^ Non-CSMR Classes: □ ^fi^^ + X 



It can be seen -from the graph that the CSMP advantage was greatest for 
classes with high reading ability, i.e.. reading score above 18 (see also page 9). 
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* Comparison of Distrfct/School Level Data , 

A much more conservative analysis than using class means was also done, 
first considering as units of analysis the 12 CSMP and 12 non-CSMP schools 
and then the 6 CSMP and 6 nonfCSMP districts . 

A separate analysis of schooV'mean scores generated results almost identical 
to the analysis qf class means, both on total MANS score and on the individual 
MANS categories. 

A separate analysis of district mean scores generated almost identical results 
on the total MANS score (sge Figure 2) and on most of the individual categories. 



Total of all 




Reading 
Score 



Fig. 2, Graph of District Means 

, Circled numeral = CSMP District - 
Plain numeral ='non-CSMP District 
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Comparison by Student Reading Level 

The mean score on the MANS scales was calculated for all students in 
approximately the lowest quarter of reading scores. This was done separately 
for CSMP and non-CSMP students. The same calculations were performed for 
students in each of the other 3 quarters of reading ability. Figure 3 shows ' 
these mean scores on the total of all the MANS scales. 

. ^ • - 



Toal of iH 
HANS Sctles 




Reading 



Fig. 3, Total MANS Scores by Reading Groups 
X = CSMP students, non-CSMP students 

Figure 3 shows fairly consistent results in favor of QSMP except for a 
slight narrowing of the' gap for the lowest level of readers. When graphs were 
drawn for the various category scores, it was found in most cases that the lines 
were parallel (quite consistent results). 



For 4 categories however » there were virtually no differences between CSMP 
and non-CSMP students in the lowest reading group, but clear differences in th6 
Other reading group. There categories were: probability, word problems, mental 
arithmetic and estimation. 
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Comparisoji of Mean Scdres for New Students ^ 

It is to be expected that students who transfer into CSMP (or into any 
program for that matter )r will be at somewhat of a disadvantage, at least 
while they "catch-up" with the rest of the class. The disadvantage may be 
greater for CSMP students where there is a greater backlog of specialized content 
to catch up on. 

r ^ ' 

Separate mean ^scores were calculated for "new" students fwho moved or were 
transferred to a participating school during the previous sumnler) and "late" students 
(who iTOved to a pkrticipating school after the first month of school). On the 
average there was about one student per class in each. category. When reading 
scores were taken into account, it was found that: 

• Both "new" and "late" CSMP students did at least as well as 
"regular" CSMP studlents of similar reading ability. The same 
result occurred for non-CSMP students. 

• CSMP students did better than non-CSMP students (for both "new " students 
and "late students), and the difference was consistent with the main 
results, the CSMP students' performance being relatively best in 

Mental Arithmetic, Decimals and Elucidation. 
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Teacher Attitudes ■ , < * 

The teaqhers of all ^of the classes participating in the testing, also completed 
questionnaires, and the results are described in this section. 

Teacher Evaluation of CSMP 

Teachers were asked to give an overall evalucition of CSMP in a free-response, 
paragraph form. About a third of the responses were categorized as enthusUstically 
positive and another half the responses were ajso positive but contained reservations 
about the program, (usually concerning insufficient emphasis on computation and the 
appropriateness for low ability students). Only 14% of the responses judged CSMP 
as "adequate" and 5% "poor". (About 60% of^.the non-CSMP teachers judged their 
program as adequate OY^ poor.) - ' . «J ^ 

Teachers were also asked to compare CSMP with the' previous math curriculum 
they had taught, using several 5-point items. Responses are given below: \n 
parenthesis are given mean scores on the same items for non-CSMP t teachers on 
Items for which there were noteworthy differences. " 

'Very favorable responses (mean scores J> 3.9) were given for: 

overall quality, \^ 
student interest and involvement (versus 3.4 for non-CSMP teachdrs)., 
students* achievement in math concepts (versus 3.4), 
students' ability to do logical reasoning (versus 2.9), and % 
appropriateness for high ability students. 

Neutral responses (mean score around 3.0) ^ere given for: 

students^ facility in solving word problems, and 
, students' achievement in computation skills (versus 3.5). 

Unfavorable' responses (mean score = 2.4) were given for: 

appropriateness for low ability students (versus 2.8). 

These responses are s'imilar to previous CSMP teachers' responses in grades 

3 and 4, with responses in grades K-2 tending to be more positive toward CSMP 

I" •/ 

than in grades 3-5. 
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these responses are also consistent with responses to' other questionnaire 
terns "answered by these fifth grade teachers/ namely: 

•^On an open-ended question* the^most frequently named "best aspects" 
of CSMP were concerned with^the promotion of reasoning and creative ^ 
thinking skills, appropriateness for high ability students, student- 
interest] and allowance for different ability levels (each named *by 
at least 25% of the teachers). 

♦ The most frequently named worst aspects concerned problems with low 
abil ity students. * 

♦ On a checklist of items for which their entering fifth graders had 
^ been inadequately prepared, basic number facts and operations and 

familiarity with fractions and with decisis were each checked by 
40^-60^ of the teachers. On a. similar checklist concerning 
inadequate coverage during 5th grade., operations with fractions was 
checked by 57% of the teachers and basic number facts, operations with 
decimals and word problems were each checked by at least 25% of the 
teachens. 

( ' f ^ 

♦ On a series of .items about the spiral ^approach, CSMP teachers overall 
gave favorable responses, but a significant minority of the teachers 
(25%-35^) expressed strong disagreement with certain apsects of it and 

. would prefer a somewhat looser v.ersion of this approach. 
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Compgri son^ of CSMP and noa-CSMP Teachers^ Attitudes . * ." ' y 

The previous section described things teachers liked and disliked about the 
program, ignoring for the moinent the responses of non-CSMP teachers to the ' 
same questions. This sectiorv summarizes differences' between the two'g;roups ^ 
of teachers' responses, regardless of whether the response was positive or negative 
in an absolute sense. (For example, 43% of the CSMP teachers checked "word 
problems" an area "not adequately covered, making it noteworthy in the last 
section, but since a similarly high dumber of non-CSMP' teachers (48%) al^o checked 
word problems, it wiH not appear in this section,') 

^ ' CSMP teachers, in comparison with non-CSMP teachers : 

a) Were- more likely to describe their math class as: ^ i ' ^ 

fun atmosphere (versus busines^s-like) r ' 

oriented towards creative activities, (versus solving specific problems) 
a harder subject to teach (versus easier) 
oriented towards general progress (versus basic sicills) 
. following lesson plans in great detail (ver^sus only as a gei;ieral guide) 

b) Were more likely to* think low ability students benefit from: . . 

small group instruction (vecsus ind^i-v^dual ) 

touching lightly on a topic several times (versus staying for mastery) 



c) In comparison to their previous math program, were more likely to 
judge their present program as superior in: 

student interest and involvement 
students* achievement in mathematical contepts 
, students' ability to do logical reasoning 
appropriateneS'S for high ability students 

and inferior in: 
achievement in computation programs. 

d) As best aspects of their program, were more likely to name: 

promotes reasoning skills/creative thinking 
allows for different ability levels 
variety of content and spiral approach 

and Idss likely to name: 

attractive format 

good coverage of the basics 

good review and supplementary materials 




e) As worst aspects of their program, were more likely tp name: 

not appropriate for low ab'il ity students \ 

and less likely to name: . " ^ 

not challenging enough/boring 

no schedule for presenting concepts 

f) As content deficiencies, were more likely to identify: 

computation - basic facts, algorithms, fraction and decimal operations 

and lessHikely to identify: 
mental arithmetic. 
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Teacher Ratings of MANS Scales 

/ 

All teachers were asked to ^ate the importance of the goals represented by 
each of- the various MANS Tests. Table 4 shows the mean rating across CSMP and 
aon-CSMP teachers, for the various tests in each category. The Categories are 
listed in order of perceived importance. 



'Table 4 

Mean Rating of Importnace - 
by MANS Category 



Category of 
MANS Tests 


Mean Ratina Across Teachers 


CSMP 


non-CSMP 


CTBS Computation 


4.9 


4.8 


Word Problems 


4.4 


4.65 


Mental Arithmetic- 


4.4 


4.3 


Fractions 


4.3 


4.3 


Decimals 


4.35 


4.25 


Organizing Data 


4.2 ' 


4.3 


Estimation 


4.1 


3.85 


Elucidation 


3.7- 


3.5 


Number Relations 


\ 3.5 


3.25 


Probability 


3.15 

• 


3.1 



The rank order of importance was almost identical' for the two groups of 
teachers, though CSMP teachers gave higher absolute ratings for Estimation^, 
Elucidation, and Number Relations; non-CSMP teachers rated Word Pr*oblems higher. 
It was also true tjiat the 5 categories in which the CSMP teachers' rating was at 
least 0.1 higher than the non-CSMP teachers were the same 5 <fategories in which 
CSMP classes had significantly higher scores at the .01 level. 

Furthermore, when^CSMP teachers were asked to judge whether gr not CSMP 
students would do better on a given 'scale then they wou^d have in af\ ordinary 
textbook program, their "predictions" agreed rather well with the actual test data 
The'7 categories with average rating scores above -3.0 (which corresponded to 
"about the same") were the same categories as those in, which CSMP classes did 
significantly better at the .05 Ifevel. The exceptions to this prediction 
accuracy were the Computation and Word Problem categories, these were rated 
as the 2 most important categories and'^lso as the 2 in which CSMP students 
would do least well; in fact CSMP students did as well as non-CSMP. students 
in Computation and significantly better in Word Problems. ' ' 



student Attitudes 

A series of attitude scales was administered to students during the MANS 
testing. Mean scores were derived ^for each class*, an Analysis of Covariance 
procedure (with Reading Comprehension as coyariate) was used with the results 
shown in Table 5-. 

Table 5 

Adjusted Mean Scores, Attitude Scales 



Attitude Scales 


Attitude Scale Means Across Classes 


*=signif leant 
at, .05 level 


CSMP 


non-CSMP 


Al: Like math versus other subjects 


10.5 


11.4 


* 


A2: S6lf concept in mathematics 


10.6 


10.5 




A3: Value of spiral approach 


4.6 


4.4 




A4: Value of estimation 


4.2 


4.0 




A5: Math is closed 


7.4 






A(5: Math is ma-inly calculation 




5.2 




A7: Math is open 


5 ft; 


5.3 


* 



CSMP classes had significantly higher scores on A7: Math is open 
(e.g., Being good at pretending helps people in math. 

Always Usually Not Usually Never ^ 

True True True True ) 

CSMP classes had significantly lower score^^ on Al : Math versus other subjects, 
which was calculated by taking the difference be^;ween how well they liked math versus 
how well they liked other subjects on items like the following: 

(What do you think about these subjects in school? 
^•9-> Science 

Like In between Do not like ) . 

For CSMP students, 51% "Liked*' mathematics versus a/i average of 58% who Uke the 
other 5 subject areas. Forj non-CSMP students, 58% likdd math and 51% liked the 
other* subjects. 

. c ■ ' 

In comparing some of the responses with responses from fourth graders in 
1979 (many of whom also participated in the present study), it was trlle for both| 
CSMP and non-CSMP students that in 5th grade they had more homework and more tests, 
and were more likely to think math boring and less likely to think it fun. 



Achievement Versus Other Data 

Correlational relationships between the various MANS scores and other data 
(implementation variables, teacher and student attitudes,^ and teacher evaluation- 
of MANS) were studied. Given the relatively small number of classes and the 
relatively large number of variables, it is rather difficult to state with . 
confidence exactly what factors lead to improvemery^ in various areas of yiathematics 
achievement. The following summary represents those relationships which are, the 
most consistent among the many variables. (In order to remove the effects of 
class ability level from these analyses, partial correlations were used.) 

Teacher Attitudes 

For CSMP Classes: 

1. Approval of CSMP tends to be related to hi'gher scores on most MANS tests . 
but lower scores on computationally oriented tests. That is, the 
correlations between teacher attitude scores (such as overall evaluation 
of CSMP, agreement with various aspects of the CSMP philosophy, etc.) 

and mean class scores on CSMP-oriented tests (dealing with decimals and 
probability, for example) are almost always positive, put correlations 
between these teacher attitude scores and mean class scores on the 
computationally oriented tests (CTBS Computation, Fractions, Mental 
Arithmetic) are almost always negative. 

» 

2. There is a set of what might be called "implementation factors" which 
is also related to higher scores on CSMP-oriented tests and lower 
scores on computationally-oriented tests. This set of factors is the 
following: 

- students report/ more games and less homework for math, 

- teacher has morfe CSMP training 

- teacher supplements less 

- class made morJe progress in schedule 

Each of these implementation factors is positively related to approval ^ 
of CSMP. ' , ' 
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Thus there is sonoe reason to- believe that teachers who are in agreement 
with the CSMP philosophy will tend to implement the program iri a reasonably 
faithful manner, resulting in higher scores in those areas which CSMP emphasizes 
and lower scores on computation tests. 

For non-CSMP Classes: 

1. Approval of the math program was positively related to math achievement of 
the class (with no distinction' between computation versus other J:ests) but 
the relationships were weak and seldom reached sigpificance. 



2. There is a set of impl enientation factors which is related to higher 
scores on the MANS tests but is unrela-ted to computation scores. This 
set of factors is the following: 

- students report fewer games and less individual help 
• teacher supplements less 

- math period is shorter 

3. ^ Frequency of testing i s. positively related to computation scores but is 

unrelated to other MANS test scores. (Frequency of testing was not an 
important factor for CSMP classes.) 

The finding in item 2 is rather difficult to explain. ^ It may be that for 
non-CSMP teachers, supplementing, with the use of games and necessitating longer 
math periods, takes time away from activities which would develop MANS skills. 
Indeed, non-CSMP teachers' supplementation covers a very wide range of activities, 
whereas for CSMP teachers it nearly always means computation practice. 



2-} 
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student Attitudes 



' .1 



The correlations betweerf class mean scores on: ' ^ \\\ • 

a) Student attitude scales, Al ; Like^math veVsus other subjects . 

. ^ and A2: Self concept in math, ^, " 

and b) Reading Comprehension, Computation, and Total MANS scores are shown below 
in^ble 6. - v 

Table 6 

Correlations between Class Mean Scores: 
" Student Attitudes versus Test -Scores ^ 





Reading 


Computation 


Total MANS 


Al ; Math versus other subjects 

' CSMP Glassies 
non-CSMP Classes 


.03 

-.15 


.24 

-.17 


.07 

-.05 


A2: Self concept in math 

CSMP Classes 
non-CSMP Classes 


-.30 

-.26 


-.05 

-.25 


-.34 

-.25 



For both CSMP and non-CSMP classes, liking math versus other subjects is virtually 
unrelated to reading and total MANS scores, and self concept is negatively related 
to reading and total MANS scores. CSMP and non-CSMP classes differ however in the 
relationship of these attitude scores to computation. For example, liking math is 
positively related to computation scores for CSMP, negatively related for non-CSMP. 

It was 'also true that CSMP classes tended to Vike math more when: 

- the teacher approved o'f the curriculum 

- fewer tests and games were reported by the students 

- supplementing occurred more often 

For non-CSMP classes, these same factors were associated with liking math less 
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Ability Level of Class ' ■ . 

There were two variables whose correlation with class ability level (as 
measured by mean reading score) were veir^y different for ^CSMP arid for non-C3MP 
"classes. 

< a) Correlation with the degree to which the teachers thought that their 
present mathprogram was inappropriate for low ability students: 
CSMP = -.10, non-CSMP = -.51. Thus for non-CSMP teachers, this 
opinion of inappropriateness was rt!5?rr often held by teachers of 
lower ability classes; for CSMP teachers holding this opinion was 
virtually unrelated to ability level of teacher's class. 

b) Correlation with the degree to which the teacher's description of math 
class corresponded to ^hat might be called a CSMP style (oriented to 
general progress, lessons proceed briskly, content is challenging, 
there is a fun atmosphere, there are creative activities): CSMP = +.46, 
non-CSMP = -.21. . Thus for CSMP, this kind of math class occurred more 
often with higher ability classes; for non-CSMP' it occurred (slightly) 
fnore often with lower ability classes. 



26' 



Summary 

The main finding in this study is that CSMP classes, as they have in ' 
comparative studies at lower grade levels* demonstrate a clear superiority over 
non-CSMP cUsses in many of the" areas of mathematical thinking assessed by the 
MANS tests. In particular, this was true about: aspects of computation other 
than the calculation of exact answers using the classic algorithms (e.g., Mental 
Arithmetic and Estimation); the production of multiple a^nswers to problems 
(Elucidation); and discovering and using mathematical patterns and functional 
relationships (Number Relationships). In addition, they had significantly higher 
scores in the three areas which receive increasing emphasis in the upper elementary 
grades, namely: fractions, decimals, and negative numbers. These gains were 
made without any corresponding decrease in scores on the more traditional areas 
of instruction: word problems (which actually showed a slight CSMP advantage) 
and computation.^ 

Item analysis data and different methods of analysis (using class, school 
and district means) confirmed these general results, though for some tests the 
advantage fov CSMP students was smaller or non-existent for students^ at thejowest 
reading level. (It should also be noted that there was a disproportionately high 
number of above average classes among the 56 participating classes.) 

Teacher reaction to CSMP was favorable, and it was more favorable than was the 
reaction of non-CSMP teachers to thei r particular program, which in most cases was 
one of the widely used, traditionally-oriented 'textbooks. * Clearly CSMP teachers 
had to "work" harder than non-CSMP teachers; aside from some kind of training 
program (often less than recommended), they usually spent more time in math class 
and spent a greater proportion of that time working with the whole group. 

Considerable supplementing of the CSMP curriculum occurred; an average of 
25% of math time was spent on activities not in the "official" curriculum. This 
percent was about the same as for non-CSMP teachers, but for those teachers 
supplementing activities were quite varied (some computation -practice-, graphs, 
enrichment, etc.) whereas for CSMP it was almost alvftiys computation practice. 




Two reVated criticisms of the curriculum by CSMP teachers stood out above 
all others. First, many teachers consider the program inappropriate in some ways 
for low ability students* Second, most teachers think that CSMP does not provide 
enough practice in computation skills, which no doubt accounts for the great 
amount of computational practice they , add to the curriculum. This in turn may 
result in longer lessons and the deletion of certain lessons (probability, geometry) 
from the schedule because of time constraints. 

From correlational data, teachers' approval of CSMP (using many different 
criteria) was associated with more "game" playing in class, less homework, more 
teacher training and less supplementing. This is not a surprising result; these 
characteristics may be thought of as indicating a more faithful version of CSMP 
in the classroom. Furthermore, these same characteristics are associated with 
higher scores in CSMP-orfented tests and lower scores in computationally-oriented 
tests. A i i 

Thus it may be that approval of CSMP, and reasonably faithful implementation 
of it, do indeed result jn improved performance in certain areas of mathematics 
but at a, possible cost in computation skills, which deficit is made up by teacher 
supplementation. But then, computational efficiency is relatively easy to 
accomplish, compared to improving student abilities in say, mental arithmetic, 
estimation, or elucidation, which are surely concomitants of good problem sowing 
skills. 
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